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DETAILED ACTION 

Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

2. Claims 1-4. 10. 13-22. and 25-31 are rejected under 35 U.S.C. 102(b) as 
being anticipated by Fiore et al. (WO 02/082275 AD. 

3. Regarding claim 1, Fiore et al. disclose a surveillance system, i.e. a monitoring 
system (see paragraph [0018]) comprising a camera, i.e. a video signal source (6) (see 
paragraph [0038]), arranged to output images of a protected area, an input device, e.g. 
an external event source (8), arranged to provide a data annotation, e.g. information 
associated with the occurrence of an external event (see paragraph [0054]), and, a 
server (20) arranged to synchronously store the images and the data annotation so that 
the data annotation can be used to search for a segment of the images (see paragraphs 
[0054] and [0057]). 

4. Regarding claim 2, Fiore et al. disclose that the server is arranged to time stamp 
the data annotation (see paragraphs [0048] and [0054]). 

5. Regarding claim 3, Fiore et al. disclose that the server is arranged to compare 
the time stamp of the data annotation to an image count, i.e. data frames with a time 
stamp approximate to the time stamp of the external event, when searching for the 
segment of the images (see paragraph [0057] and claim 9 ). 
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6. Regarding claim 4, Fiore et al. disclose that the server is arranged to cause the 
segment of the images matching the time stamp to be displayed, i.e. providing the 
retrieved portion to an output apparatus (see paragraph [0057], lines 7-11). 

7. Regarding claim 10, Fiore et al. disclose that the camera comprises a video 
camera (see paragraph [0038]), and wherein the server comprises a video server, i.e. a 
server for storing video signals and its associated data (see paragraph [0038], lines 7- 

9). 

8. Method claims 13-22 and 25-31 are drawn to the method of using the 
corresponding apparatus claimed in claims 1-4. Therefore method claims 13-22 and 
25-31 correspond to apparatus claims 1-4 and are rejected for the same reasons of 
anticipation as used above. 

Claim Rejections - 35 USC § 103 

9. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

10. Claims 5-8. 23. 24. 32-34. 36. and 37 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Fiore et al. (WO 02/082275 AD as applied to claims 1-4. 
10. 13-22. and 25-31 above, and further in view of Brown et al. (WO 01/13637 A1). 
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1 1 . Regarding claim 5, as mentioned in the discussion of claim 1 above, Fiore et al. 
disclose all the limitations of the parent claim. Fiore et al., however, do not teach that 
the server is arranged to save the data annotation in SQL readable form. Brown et al., 
on the other hand, disclose that the video server database is implemented using SQL 
(see page 47, lines 14-15), which is a standardized computer language to create, 
retrieve, update or delete data from a relational database. It would have been obvious 
to one having ordinary skill in the art at the time the invention was made to implement 
the database of the video server taught by Fiore et al. using SQL, as described by 
Brown et al., because the system would have been easier to create, update and 
maintain since SQL is such a well-known computer query language. 

12. Regarding claim 6, Fiore et al., as modified by Brown et al., disclose that the 
server is arranged to time stamp the data annotation (see Fiore et al., paragraphs 
[0048] and [0054]). 

1 3. Regarding claim 7, it would be inherent to arrange the server of Fiore et al., as 
modified by Brown et al., to receive an SQL search string corresponding to the data 
annotation since the video server database is implemented using SQL. In addition, 
Fiore et al., as modified by Brown et al., disclose the use of a string search to retrieve 
the data annotation, i.e. an event type, an event description, etc. (see Brown et al., page 
73, lines 7-23, and figures 46 and 47). 

14. Regarding claim 8, Fiore et al., as modified by Brown et al., disclose that the 
server is arranged to match the data annotation found as a result of the search to the 
segment of the images (see Brown et al., page 73, lines 7-23, and figures 46 and 47). 



Application/Control Number: 10/736,113 Page 5 

Art Unit: 2622 

15. Regarding claim 9, Fiore et al., as modified by Brown et al., disclose that the 
server is arranged to match the time stamp of the data annotation to an image count 
when searching for the segment of the images (see Fiore et al., paragraph [0057] and 
claim 9). 

16. Method claims 23-24 and 32-33 are drawn to the method of using the 
corresponding apparatus claimed in claims 5-9. Therefore method claims 13-22 and 
25-31 correspond to apparatus claims 5-9 and are rejected for the same reasons of 
obviousness as used above. 

17. Regarding claim 34, as mentioned above, Fiore et al. disclose all the limitations 
of the parent claim. Fiore et al., however, do not explicitly teach that the link comprises 
a data attribute stamp wherein the data attribute serves as an index to retrieve video 
and data segments of the same characteristic inferred by the data attribute. On the 
other hand, Brown et al. disclose that the link comprises a data attribute stamp, 
interpreted as a searchable recording criteria other than date or time, wherein the data 
attribute serves as an index to retrieve video and data segments of the same 
characteristic inferred by the data attribute (see Brown et al., page 73, lines 7-23, and 
figures 46 and 47). It would have been obvious to one having ordinary skill in the art at 
the time the invention was made to have used a data attribute for indexing associated 
video and data segments as taught by Brown et al. in the method disclosed by Fiore et 
al. since doing so would enable the user to search for information associated with an 
event even if she is unaware of the exact instance when the event occurred. 

18. Regarding claim 36, Fiore et al., as modified by Brown et al., disclose that the 
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data attribute comprises luminosity, i.e. an event type associated with drastic changes 
in brightness (see Fiore et al., paragraphs [0044], lines 4-6). 

19. Regarding claim 37, Fiore et al, as modified by Brown et al., disclose that the 
data attribute comprises a biometric signature, i.e. an event type associated with 
identification of an individual using image recognition (see Brown et al., page 23, lines 
14-21). 

20. Claims 11 and 12 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Fiore et al. (WO 02/082275 A1) as applied to claims 1-4, 10. 13-22. and 25-31 
above, and further in view of Arazi et al. (US 6.330.025 BP. 

21 . Regarding claim 11, as mentioned in the discussion of claim 1 above, Fiore et al. 
disclose all the limitations of the parent claim. Fiore et al., however, do not teach that 
that the camera comprises an IR camera. Arazi et al., on the other hand, teach the use 
of a forward-looking IR camera (54). It would have been obvious to one having ordinary 
skill in the art at the time the invention was made to use an IR camera, as described by 
Arazi et al., as a video signal input in the system disclosed by Fiore et al. since the use 
of an IR camera provides a monitoring function even in low-light environments. 

22. Regarding claim 12, as mentioned in the discussion of claim 1 above, Fiore et al. 
disclose all the limitations of the parent claim. Fiore et al., however, do not teach that 
that the camera comprises a thermal imager. Arazi et al., on the other hand, teach the 
use of a forward-looking IR camera (54), which inherently is a thermal imager. It would 
have been obvious to one having ordinary skill in the art at the time the invention was 
made to use a forward-looking IR camera, as described by Arazi et al., as a video signal 
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input in the system disclosed by Fiore et al. since the use of such a thermal imager 
provides a monitoring function even in low-light environments. 

23. Claim 35 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Fiore et al. (WO 02/082275 A1) in view of Brown et al. (WO 01/13637 A1). and 
further in view of Arazi et al. (US 6,330.025 BP. 

24. Regarding claim 35, as mentioned above, Fiore et al., as modified by Brown et 
aL, disclose all the limitations of the parent claim. However, Fiore et al., as modified by 
Brown et al., do not disclose that the data attribute comprises temperature. Arazi et al., 
on the other hand, teach that the data attribute comprises temperature, i.e. an event 
type associated with changes in heat signatures (see Arazi et al., col. 7, lines 20-23). It 
would have been obvious to one having ordinary skill in the art at the time the invention 
was made to use temperature as a data attribute because drastic changes in heat 
provide a monitoring function even in low-light environments. 

Conclusion 

25. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

• Paff (US 5,526,133) discloses a method and a system for surveillance that stores 
and retrieves video data using annotation data. 
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26. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Wanda M. Negron whose telephone number is (571) 
270-1 129. The examiner can normally be reached on Mon-Fri 6:30 am - 4:00 pm 
alternate Fri off. 

27. If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Ometz can be reached on (571 ) 272-7593. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

28. Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Wanda M. Negron 

February 2, 2007 ^ 




